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Abstract 

A square {+1, — Ij-matrix of order n with maximal determinant is 
called a saturated D-optimal design. We consider some cases of satu- 
rated D-optimal designs where n > 2, n ^ mod 4, so the Hadamard 
bound is not attainable, but bounds due to Barba or Ehlich and Woj- 
tas may be attainable. If i? is a matrix with maximal (or conjectured 
maximal) determinant, then G = RR^ is the corresponding Gram ma- 
trix. For the cases that we consider, maximal or conjectured maximal 
Gram matrices are known. We show how to generate many Hadamard 
equivalence classes of solutions from a given Gram matrix G, using a 
randomised decomposition algorithm and row/column switching. In 
particular, we consider orders 26, 27 and 33, and obtain new satu- 
rated D-optimal designs (for order 26) and new conjectured saturated 
D-optimal designs (for orders 27 and 33). 

1 Introduction 

The Hadamard maximal determinant (maxdet) problem is to find the maxi- 
mum determinant D{n) of a square — l}-matrix of given order n. Such 
a matrix A with maximal | det(74)| is called a saturated D-optimal design of 
order n. We are only concerned with the absolute value of the determinant, 
as the sign may be changed by a row or column interchange. 

Hadamard [9] showed that D(n) < n"/^, and this bound is attainable for 
n > 2 only if n = mod 4. The "Hadamard conjecture" (due to Paley [20j) 
is that Hadamard's bound is attainable for all n = mod 4. In this paper 
we are concerned with "non-Hadamard" cases n > 2, n ^ mod 4. For such 
orders the Hadamard bound is not attainable, but other upper bounds due 



to Barba [T], Ehlich [TJ |8] and Wojtas [26] may be attainable. For lower 
bounds on D{n), see Brent and Osborn [3], and the references given there. 

We say that two {+1,-1} matrices A and B are Hadamard-equivalent 
(abbreviated H-equivalent) if B can be obtained from A by a signed per- 
mutation of rows and/or columns. If A is H-equivalent to B or to B^ then 
we say that A and B are extended Hadamard-equivalent (abbreviated HT- 
equivalent). Note that, if A is HT-equivalent to B, then | det(j4)| = | det(i?)|. 

If A is H-equivalent to then we say that A is self-dual. We say that 
a Hadamard equivalence class is self-dual if the class contains a self-dual 
matrix (equivalently, if the dual^ of all matrices in the class are also in the 
class). 

If we know (or conjecture) D{n), it is of interest to find all (or most) 
Hadamard equivalence classes of {+1, —1} matrices with determinant ibD(n). 
In this paper we consider the orders 26, 27 and 33; similar methods can be 
used for certain other orders. 

In ^ we consider the randomised decomposition of (candidate) Gram 
matrices. Then, in ^ we show how one solution can often be used to 
generate other, generally not Hadamard equivalent, solutions via switching. 
The graph of Hadamard equivalence classes induced by switching is defined 
in ^ We conclude with some new results for the orders 26, 27 and 33 in 



Upper bounds 

A bound which holds for all odd orders, and which is known to be sharp for 
an infinite sequence of orders = 1 (mod 4) , is 



due independently to Barba [T] and Ehlich [7]. We call it the Barba bound. 
Brouwer [5] showed that the Barba bound ([l]) is sharp if n = + (g + 1)^ 
for q an odd prime power. The bound is also sharp in some other cases, 
e.g. q = 2 and g = 4. It is not achievable unless n is the sum of two 
consecutive squares. 

An upper bound due to Ehlich [H] applies only in the case n = 3 (mod 4) . 
We refer to [31 [H [181 [19] for details of this bound, which is rather complicated. 
The Ehlich bound is not known to be sharp for any order n > 3. 

Another bound. 



D{n) < {2n - 1) 



l/2(^_l)(n-l)/2 



(1) 



D{n) < (2n-2)(n-2)("-2)/2 



(2) 



We use "dual" and "transpose" interchangeably. 



2 



due to Ehlich [7J and Wojtas f26j, applies in the case n = 2 (mod 4). It is 
known to be sharp in the following cases: (A) n = 2{q^ + {q + 1)^)) where 
q is an odd prime power (see Whiteman j2S]); and (B) n = 2{q^ + q + I), 
where q is any (even or odd) prime power \22\ I12j . 

Gram matrices 

If i? is a given square matrix then the symmetric matrix G = RR^ is 
called the Gram matrix of R. We may also consider the dual Gram matrix 
H = R^R. Since det(G) = det(i?)^, the bounds mentioned above on det(i?) 
are equivalent to bounds on det(G). Indeed, this observation explains the 
form of the bounds. For example, the Barba bound corresponds to a matrix 
G = {gij) given by gij = n \i i = j and gij = 1 if i ^ j. It is easy to show 
via a well-known rank-1 update formula that det(G) = (2n — l)(n — 1)"""^. 

Given a symmetric matrix G with suitable determinant, we say G is a 
candidate Gram matrix. It is the Gram matrix of a {+1,-1} matrix if and 
only if it decomposes into a product of the form G = RR^, where R is a. 
square {+1, —1} matrix. 

2 Decomposition of candidate Gram matrices 

Suppose that a (candidate) Gram matrix G of order n is known. We want 
to find one or more {+1,-1} matrices R such that G = RR^ . Let the rows 
of R be r^, . . . , r^. Then 

fl^j = gij, I <ij <n. 

If we already know the first k rows, then we get k single- Gram constraints 
involving row k + 1: 

rfru+i = gi,k+i for 1 < i < A;. 

These are linear constraints in the unknowns rk+i- We may be able to find 
one or more solutions for row k + 1 satisfying the single-Gram constraints, 
or there may be no solutions, in which case we have to backtrack. 

Our algorithm is described in O §4], so we omit the details here. We 
merely note that it is possible to take advantage of various symmetries to 
reduce the size of the search space, and that it is possible to prune the search 
using gram-pair constraints of the form G^~^^ = RH^R^ {j > 0) if we know 
the dual Gram matrix H = RT R. In the cases considered below, there is (up 
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to signed permutations) only one candidate Gram matrix with the required 
determinant, so there is no loss of generality in assuming that G = H. 

The search can be regarded as searching a (large) tree with (at most) n 
levels, where each level corresponds to a row of R. A deterministic search 
typically searches the tree in depth-first fashion - at each node, recursively 
search the subtrees defined by the children of that node. The aim is to find 
one or more leaves at the n-th level of the tree, since these leaves correspond 
to complete solutions R. 

Deterministic, depth-first search may take a long time searching fruit- 
lessly for solutions in subtrees where no solutions exist. When G is decom- 
posable, but difficult to decompose using a deterministic search, we may be 
able to do better with a randomised search. 

In the randomised search, at each node we randomly choose a small 
number of children and recursively search the subtrees defined by these 
children. A good choice of the average number of children chosen per node, 
say jj,, can be determined experimentally. Too small a value makes it unlikely 
that a solution will be found; too large a value makes the search take too 
long. We found empirically that ^ ~ 1.3 works well in the cases considered 
below. Thus, at each node traversed in the search we choose one child (if 
there are any) and, with probability about // — 1 « 0.3, also choose a second 
child (if there is one), then recursively search the subtrees defined by the 
selected children. 

For example, in the case n = 27, there is a known Gram matrix G, due 
to Tamura [2^, which decomposes into RR^ , giving a {+1, —1} matrix R of 
determinant 546 x 6^^ x 2^^. This determinant is conjectured to be maximal. 

A deterministic search fails to decompose Tamura's G in 24 hours (ex- 
ploring over 10^ nodes but reaching only depth 17 in the search tree). The 
tree size is probably greater than 4 x 10^. 

On the other hand, our randomised search routinely finds a decomposi- 
tion of G in about 90 seconds. In this way we have found many different 
H-classes of solutions. Further details are given in ^ 

Nonuniformity of sampling 

Unfortunately, the randomised search strategy described above does not 
guarantee that the set of H-classes of solutions (or the set of all {+1,-1} 
matrices of the given order and determinant) is sampled uniformly. There 
are two reasons for lack of uniformity. First, the tree- generation algorithm 
introduces non-uniformity by taking advantage of symmetries to reduce the 
size of the tree. Second, the number of matrices in a class is inversely 
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proportional to the order of the automorphism group of the class, so even if 
all the {+1,-1} matrices were sampled uniformly, the H-classes would not 
necessarily be sampled uniformljP] 



3 Switching 

Switching is an operation on square {+1,-1} matrices which preserves the 
absolute value of the determinant but does not generally preserve Hadamard 
equivalence or extended Hadamard equivalence. 

Thus, switching can be used to generate many inequivalent maxdet solu- 
tions from one solution. This idea was introduced by Denniston [6] and used 
to good effect by Orrick [16]. Similar ideas have been used by Wanless [23] 
and others in the context of latin squares. 

We only consider switching a closed quadruple of rows/columns. There 
are other possibilities, e.g. switching Hall sets jl6] . 



Switching a closed quadruple of rows/columns 



Suppose that a {+1,-1} matrix R is H-equivalent to a matrix having a 
closed quadruple of rows, i.e. four rows of the fornj^ 
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This is H-equivalent to flipping the signs of all but the leftmost block, 
which has a nicer interpretation in terms of switching edges in the corre- 
sponding bipartite graph [HI [15] . 

It is easy to see that row switching preserves the inner products of each 
pair of columns of R, so preserves the dual Gram matrix R^R, and hence 



To a certain extent, these two sources of bias may tend to cancel. 



We write "+" for +1 and 



for 
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preserves |det(i?)|. However, it does not generally preserve H-equivalence 
or HT-equivalence. 

Column switching is dual to row switching ~ instead of a closed quadruple 
of four rows, it requires a closed quadruple of four columns. 



Equivalence classes generated by switching, and their graphs 

Let A and B be two H-equivalence classes of matrices. We say that A and B 
are switching-equivalent (abbreviated "S-equivalent" ) if there exists A €z A 
and B £ B such that A can be transformed to -B by a sequence of row and/or 
column switching operation^ The size of an S-equivalence class C, denoted 
by IICIIs, is the number of H-equivalence classes that it contains. 

If the H-equivalence classes corresponding to matrices A and B are in 
the same S-equivalence class, then we write A -H- B. Thus, this notation 
means that there is a sequence of row/column switches that transforms A 
to a matrix H-equivalent to B. We say that A is S-equivalent to B. 

If A and B are two HT-equivalence classes of matrices, then we say that 
A and B are ST-equivalent if there exists A £ A and B £ B such that A 
can be transformed to S by a sequence of row and/or column switching 
operation^ The size of an ST-equivalence class C, denoted by ||C||5T) is 
the number of HT-equivalence classes that it contains. 

We say that two matrices A and B are ST-equivalent if the corresponding 
HT-classes A3 A and B 3 B are ST-equivalent. Thus, two matrices A and 
B are ST-equivalent if a matrix H-equivalent to B can be obtained from A 
by a sequence of row switches, column switches and/or transpositions. 

The weight w{H) of a matrix H (or of the Hadamard class % 3 H) is 
defined by 

where Aut(if) is the automorphism group of H. The weight w{C) of an 
S-class C is defined by 

w{c) = . (4) 

The probability of finding a class by uniform random sampling of {+1, — 1} 
matrices is proportional to the weight of the class, so the classes with smallest 
weight are in some sense the hardest to find. (However, as observed at the 
end of ^ we do not sample uniformly.) 

* S-equivalence is the same as Orrick's Q-eqmvalence [161 117j in the cases that we con- 
sider, but the concepts are different if n = 4 mod 8. 

^Thus, for all Q G ^ and /S € B, we have either a P or a /3"^. 
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Associated with an S-equivalence class S = {Hi, . . . , Hg} of size s there 
is a graplj^G = G{S) whose vertices are the H-classes Hi, . . . , Hg contained 
in S, and where an edge connects two distinct vertices Hi,Hj if a matrix in 
Hi can be transformed to a matrix in Hj by a single row/column switching 
operation. Similarly, for an ST-equivalence class C = {Hi, . . . , Hs} of size s 
there is a graph G = G(C) whose vertices are the HT-classes Hi, . . . ,Hs 
contained in C, and where an edge connects two distinct vertices Hi, Hj if a 
matrix in Hi can be transformed to a matrix in Hj by a single row/column 
switching operation, possibly combined with transposition. 

For example, it is known |101lllj that there are 60 H-classes of Hadamard 
matrices of order 24. These form two S-classes, of size 1 and 59. Similarly, 
there are 36 HT-classes, giving two ST-classes, of size 1 and 35. In each case 
the class of size 1 contains the Paley matrix, which has no closed quadruples. 

4 Results for order 26 

For order 26 the maximal determinant is L'(26) = 150 x 6^^ x 2^^, meeting 
the Ehlich-Wojtas bound ([2]), and the corresponding Gram matrix G is 
unique up to symmetric signed permutations. Without loss of generality we 
can assume that G has a diagonal block form with blocks of size 13 x 13 
(see [3 [181 ES]). There are exactly three H-inequivalent maxdet matrices 
composed of circulant blocks |27| [T3] . However, there are many solutions 
that are not composed of circulant blocks. Orrick [171 Sec. 7] found 5026 
HT-classes (9884 H-classes) of solutions by a combination of hill-climbing 
(local optimisation) and switching. 

Using randomised decomposition of the Gram matrix G followed by 
switching, we have found 39 further H-classes (23 HT-classes). Thus, there 
are at least 9923 H-classes (5049 HT-classes) of saturated D-optimal designs 
of order 26. Since the randomised decomposition program has repeatedly 
found the same set of 9923 H-classes without finding any more, it is reason- 
able to conjecture that this is all. An exhaustive search to prove this may 
be feasible, but has not yet been attempted. 

It is known [TJ [T7] that there are two types of maxdet matrices of order 
n = 26, related to the two ways that the row sums 2n — 2 = 50 of the Gram 
matrix can be written as a sum of squares: 

50 = 7^ + l2 = 5^ + 5^ 
®We ignore any loops or multiple edges, so all graphs considered here are simple. 
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Table 1: 25 S-classes and 18 ST-classes for order 26 



They are called "type (7, 1)" and "type (5, 5)" respectively. The type is 
preserved by switching. If a maxdet matrix R of order 26 is normalised so 
that RR'^ = R^R = G, then 

i j 

determines the type of R: maxdet matrices of type (7, 1) have X{R) = 182, 
and those of type (5, 5) have X{R) = 130. 

There are 5049 HT-classes (9923 H-classes) which lie in 18 ST-classes 
(25 S-classes). There is one "giant" ST-class Q with size ||^||st = 4323, 
consisting of type (5, 5) matrices. 

There is another "large" ST-class £ with ||£"||5r = 686, consisting of 
type (7, 1) matrices. 

Each ST-class C of size s = | |C| Isr corresponds to either one S-class Ci (of 
size < 2s) or two S-classes Ci, C2 (each of size \\Ci\\s = s), depending 

on whether or not the ST-class contains a self-dual matrix. In the former 
case we say that the ST-class is self-dual, otherwise we say that the ST-class 
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Figure 1: The ST-class of size 11 for maxdet matrices of order 26 



splits. For example, the ST-class of size 11 is self-dual and corresponds to 
an S-class of size 19, but the ST-class of size 5 splits to give two S-classes 
of size 5. Details of all the known classes are given in Table 1. The third 
column of the table gives the weight (s) of the S-class(es) in that row, where 
the weight is defined by Q above. The entries labelled "new" are not given 
in Orrick's paper [17J. The classes labelled < -Ri > (1 < i < 3), are generated 
by matrices composed of circulant blocks, using the notation of |18j . The 
graph associated with the ST class of size 11 is shown in Figure 1. 

The largest automorphism group order is 22464 = 2^-33 -13, and all group 
orders divide 22464. The distribution of group orders is given in Table 2. 
In the table, the columns headed give the number of times that the 
corresponding group order occurs. A list of (representatives of) H-classes 
and their group orders is available from [2j. 

To summarise the main results, we have: 

Theorem 1. For order 26 there are at least 9923 Hadamard classes of 
{-|-1, — 1} matrices with determinant 150 x 6^^ x 2^^. They lie in at least 
25 switching classes, as given in Table 1. 

Proof. The proof is computational. On our website [2] we give represen- 
tatives of each of the 18 ST-classes. From these "generators", a program 
that implements switching can find all 5049 HT-classes; this requires only 
12 iterations of row/column switching and taking duals. By taking duals of 
the 7 generators that are not self-dual, we obtain 25 generators for the 9923 
H-classes. □ 
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Table 2: Group orders of 9923 H-classes for order 26 



5 Results for order 27 

It is known that the maximal determinant D{27) for order 27 satisfies 

D(27) 
546 < , / ' < 565, 
- gii X 226 

where the lower bound is due to Tamura {23j, and the upper bound is the 
(rounded up) Ehlich bound [8j. It is plausible to conjecture that the lower 
bound 546 x 6 1 X 2^6 is maximal, since it is 0.9673 of the Ehlich bound and 
has not been improved despite attempts using optimisation techniques that 
have been successful for other orders [18j. Unfortunately, proving that the 
lower bound is maximal seems difficult - the technique used in [3] to prove 
analogous results for orders 19 and 37 is impractical for order 27 due to the 
size of the search space. 

Tamura found a {+1, —1} matrix R, with determinant 546 x 6^^ x 2^6. 
The corresponding Gram matrix G = RR^ has a block form with diago- 
nal blocks of sizes (7,7,7,6). Orrick [1^ showed that Tamura's matrix R 
generates an ST-class T with ||T||5r = 33. The ST-class T splits into two 
S-classes, each containing 33 H-classes. 

Using randomised decomposition of Tamura's (conjectured maximal) 
Gram matrix, followed by switching, we have the following result. 

Theorem 2. There are at least 6489 HT-classes (12911 H-classes) of {±1} 
matrices of order 21 with determinant 546 x 6^"^ x 2^6. They lie in at least 
204 ST-classes (388 S-classes). The largest ST-class contains at least 5765 
HT-classes (11483 H-classes). 

Proof. The proof is computational. On our website j2] we give represen- 
tatives of each of the 204 ST-classes. From these "generators", a program 
that implements switching can find all 6489 HT-classes; this requires only 
28 iterations of row/column switching and taking duals. By taking duals of 
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Table 3: 204 ST-classes for order 27 



the 184 generators that are not self-dual, we obtain 388 generators for the 
12911 H-classes. □ 

Details of the 204 known ST-classes are summarised in Table 3. Twenty 
of these ST-classes are self-dual; the remaining 184 each split into two S- 
classes. In the table, the columns headed "||C||5t" give the size of an ST- 
class C, the next columns "7^" give the number of such classes, and the 
columns "#split" give the number of these that split into two S-classes. 

There is one "giant" class Q of size 5765 HT-classes (11483 H-classes) 
and 203 small classes (maximum size 36 HT-classes). Tamura's matrix R 
generates the third- largest class, of size 33 HT-classes (66 H-classes). Unlike 
order 26 (see Q, there is no obvious subdivision of the classes into types. 

Automorphism group orders for the 12911 H-classes are summarised in 
Table 4. Tamura's matrix R has group order 3. 



Order 


multiplicity 


1 


12738 


2 


26 
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131 
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16 



Table 4: Distribution of group orders for 12911 H-classes 



6 Results for order 33 

For order 33, the Barba bound Q gives D{33) < 516 X 2^"^. Using the 
algorithm described in |3], we have shown that none of the 13670 candidate 
Gram matrices G satisfying det(G)^/^ > 470 x 2^'^ can decompose into a 
product RR'^, where R G {+1, -l}33x33^ ^hus, we have £>(33) < 470 x 2'^^. 
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Figure 2: ST-classes of size 28 and 36 for matrices of order 27 



On the other hand, Solomon [211 [TBj found a matrix i?G{+l,— 1}'^'^^^^ 
with det(i?) = 441 x 2^^, which is greater than 0.9382 of the upper bound. 
Thus, we know that 

441 < D(33)/2'^^ < 470. 

It is plausible to conjecture that the lower bound is best possible and 
L>(33) = 441 X 2^^. Proving this seems difficult, for reasons given in [3l 
§7.1]. In this section we find a large number of H-classes of solutions with 
determinant 441 x 2''^. Even if the conjecture proves to be incorrect, the same 
techniques should be applicable to find many or all H-classes of solutions 
with larger determinant. 

Starting from the Gram matrix G = R = RR^ corresponding to 
Solomon's {+1,-1} matrix R, our randomised tree search algorithm can 
find many solutions with the same determinant. 

Using row/column switching and duality, we can find a huge number of 
inequivalent solutions. For example, starting from Solonon's matrix R and 
iterating the operation of row switching only, we found 37030740 H-classes 
in 11 iterations before stopping our program because it was using too much 
memory. Clearly a different strategy is needed. 
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Exploring the switching graph using random walks 

Given solutions and Bq, we can generate random walks {Aq, Ai,A2,...) 
and {Bq, Bi, B2, . . .) in the graph defined by row/column switching and 
transposition. Each vertex on a walk is connected by a row/column switch- 
ing operation and possibly transposition to its successor. 

If Aq and Bo are in different connected components, then the two ran- 
dom walks cannot intersect. However, if Aq and Bq are in the same con- 
nected component, of size s say, then wc expect the two walks to intersect 
eventually, and probably after 0{^/s) steps unless the mixing time of the 
walks is too long (this depends on the geometry of the component, which is 
unknown) . 

Our implementation uses self-avoiding random walks. Each walk is 
stored in a hash table so we can quickly check if a new vertex has already 
been encountered in the same walk (in which case we try one of its neigh- 
bours) or in the other walk (in which case we have found an intersection). If, 
during a walk, all neighbours of the current vertex have been visited, then 
it is necessary to backtrack. This occurs rarely since the mean degree of a 
vertex is large (see below). 

We fix ^0 = ^ and choose Bq randomly. Usually (about 90% of the 
time) R and Bq are in the same connected component, nearly always the 
"giant" component Q. Otherwise, Bq is in a "small" component (of size 
say s) and we discover this by being unable to continue the self-avoiding 
walk from Bq past Bg-i- 

In this way we find many vertices of the giant component Q, and also 
many "small" ST-classes. 

We can gather statistics from the random walks. For example, we would 
like to estimate ||^||5r, the total number of HT-classes (i.e. connected com- 
ponents) in the graph, the number of ST-classes, the mean degree of each 
vertex, etc. 

If implemented as described above, the random walks are not uniform 
over the vertices of the connected components containing their starting 
points. They are approximately uniform over edges, so the probability of 
hitting a vertex v depends on the degree deg(w). 

We can either take this into account when gathering statistics, or avoid 
the problem by accepting a candidate vertex v with probability 1/ deg{v). In 
this way the vertices are sampled uniformly if the walks are long enough. The 
drawback is that we have to compute the degrees of all candidate vertices 
(all neighbours of the current vertex), which might be time-consuming. 
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Results from random walks 

We estimate that the overall size of the graph is (3.08 ± 0.09) x 10^ when 
measured in HT-classes. (In terms of H-classes the numbers are roughly 
doubled, since self-dual classes are rare.) The giant component Q has size 
ll^llsT ~ (2.83 ± 0.08) X 10^. In Q the mean degree of each vertex is about 
20, so there are about 2.83 x 10^° edges. 

We estimate that there are about 5 x 10^ small ST-classes, with mean 
size about 5. Of these we found more than 8 x 10^ so far, with the largest 
having size 2136 (see Table 5). 

We have found 1639 singletons (ST-classes of size 1) and 5412 self-dual 
matrices. One self-dual singleton was found. 

The automorphism group orders observed during random walks arc in 
{1,2,4}, with orders greater than 1 being rare. Solomon's R has group 
order 2. 

Although most of these observations are imprecise, since they depend on 
random sampling, we can at least claim the following: 

Theorem 3. For order 33 and determinant 441 x 2^^^, the ST-class Q gen- 
erated by Solomon's matrix R is self-dual and has size \\Q\\st > 197 x 10^. 
There are at least 8 x 10^ smaller ST-classes, 20 of which are listed in Ta- 
ble 5. 

Proof. As usual, the proof is computational. Starting from R, we found 
197122852 HT-classes in 9 iterations of row/column switching and taking 
duals. 

Starting random walks from R and R^, and performing row/column 
switching only, we found an intersection. Thus R -H- R^. It follows that Q 
is self-dual. □ 

Remarks 

1. Although R is not self-dual, we found many self-dual matrices in the 
giant class Q in the course of various random walks. Eight such matrices are 
at distance 3 from R. The existence of a self-dual matrix in Q is sufficient 
to show that Q is self-dual. 

2. In addition to the giant class Q of size about 2.83 x 10*^, we found 20 
ST-classes of size > 900, as listed in Table 5, with the largest having size 
2136. Classes of the same size marked "(a)" and "(b)" are different, so there 
are (at least) two disjoint classes of size 999. 

3. Table 5 gives the number of times Aj that we found the same class 
of size Si. This statistic is mentioned because it indicates how well we have 
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size Si 




size Sj 




ZioD 


9 


1 1 nn 


i 


1300 


4 


1069 


2 


1276 


2 


1011 


1 


1246 


1 


1008 


1 


1205 


4 


999 


1(a) 


1188 


4 


999 


2(b) 


1187 


1 


993 


2 


1148 


2 


958 


2 


1134 


2 


918 


3 


1104 


2 


909 


3 



Table 5: Some large ST-classes for order 33 



sampled the search space. Excluding the giant class G, the 20 largest known 
classes, of total size Si = 22888, were found ^ Aj = 42 times. Consider 
the union U of these classes as a sample from the space, and assume that 
the space is sampled uniformly. Excluding the 20 "hits" used to select U, 
there are ^^(Ai — 1) = 22 additional "hits" on U. Thus, the fraction p of 
the space sampled is p ^ Y^i^i - ^)/Y.Si = 22/22888 w 1/1040. Under 
our assumption, the probability P of missing a given class of size > 2136 is 
bounded by 

P<{l-pf^'^'^ < 1/7. (5) 

On the other hand, random sampling hit the giant class 1.04 x 10^ times, 
and the estimated size of this class is 2.83 x 10^, implying that p ~ 1/2720, 
so the estimate ([s]) on P should be viewed with caution. The discrepancy 
between the two estimates of p may be caused by nonuniformity of sampling 
and/or by an inaccurate estimate of the size of the giant class. 

4. It would be interesting to know more about the graphs associated 
with "small" ST classes. We have observed one graph of size 3 ("V"), two 
of size 4 ("U" and "□"), and only one of size 5 ("kite"). Figure 3 shows an 
example of each size in the range 10, . . . , 19. 

5. The reader may have noticed that the graphs displayed in Figures 
1-3 are bipartite (2-colourable), although neato did not draw them in a 
way that makes this obvious. Computational experiments have shown that 
most, but not all, of the ST classes considered above have bipartite graphs. 
In particular, the graph of the giant component for order 33 is not bipartite. 
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Figure 3: One ST-class of each size 10, . . . , 19 for order 33 
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